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Abstract 

Parrondo's paradox occurs in sequences of games in which a winning expectation value of 
a payoff may be obtained by playing two games in a random order, even though each game 
in the sequence may be lost when played individually. Several variations of Parrondo's games 
apparently with the same paradoxical property have been introduced 5 ; history dependence, 
one dimensional line, two dimensional lattice and so on. I have shown that Parrondo's paradox 
does not occur in scale free networks in the simplest case with the same number of parame- 
ters as the original Parrondo's paradox[l7]. It suggests that some technical complexities are 
i-4 ' needed to present Parrondo's paradox in scale free networks. In this article, I show that a 

simple modification with the same number of parameters as the original Parrondo's paradox 
creates Parrondo's paradox in scale free. This paradox is, however, created by a quite different 
mechanism from the original Parrondo's paradox and a considerably rare phenomenon, where 
the discrete property of degree of nodes is crucial. I call it the second Parrondo's paradox. 

keywords: Parrondo's paradox, Parrondo's paradoxCScale free network, Game theory 

Jm . 1 Introduction 



Of 



Parrondo's games were first devised by Parrondo [I] who presented them in unpublished. 
Parrondo's paradox is based on the combination of two losing games. However, the randomly 
combined two games give rise to a winning game pointed out by [5] and [3J. It was pointed out 
that Fokker Planck equation connects Parrondo's games with the flashing Brownian ratchet [J]. 
The original Parrondo's game consists of two losing games A and B where each is played by only 
one player. In Game A, only one biased coin is used, while in Game B two biased coins are 
used with the player's current capital determining the state dependent rule. When a player plays 
individually each game, he/she loses his/her capital on average. However, when the player plays 
two games in any combination, he/she always wins on average. 

Several variations of Parrondo's games apparently with paradoxical property have been intro- 
duced. First capital dependence in Game B was replaced by recent history of wins and loses [6]. It 
has the same paradoxical property as the original one. For it, an analytical study has been made 
[7]. Secondly the capital dependence in Game B was replaced by spatial neighbor dependence 
in one dimensional line [5], [5], |10) . and von Neumann neighbor dependence in two dimensional 
lattice [TT]. Some analogous variations have been given by [T^], [T3J. Among such positive studies, 
I have especially shown that Parrondo's paradox does not occur in scale free networks in the sim- 
plest case with the same number of parameters as the original Parrondo's paradox[17 . This fact 
suggests that some technical complexities arc needed to present Parrondo's paradox in scale free. 
A fine review of Parrondo's paradox and references except for my work are given in [5]. 

In this article, I explore still harder about Parrondo's paradox in scale free networks [Tl] . |1 5] . 
The study of Parrondo's paradox in scale free networks is interesting as an empirical study, since 
scale free networks are ubiquitous in our real world[16 . In this article I show that a simple 
modification to the games with the same number of parameters as the original Parrondo's paradox 
creates Parrondo's paradox in scale free networks. In the model of this article, each player on a 
network plays a game L when there are not more than rki winners in the neighborhood connected 
to the player and plays a game W otherwise in Game B, where fe, is the degree of node i and r is a 
parameter taking between and 1. As the theoretical studies, first the conditions for Parrondo's 
paradox are obtained. I give some simulation result which remarkably shows a paradox occurs 
based on the conditions. But another theoretical consideration shows that such paradox never 
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Figure 1: C(t) in Game A and Game B for P A = 0.48, P^ = 0.01 and P^> = 0.85 at 1600 steps. 
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Figure 2: C(t) in Game A+B for P = 0.5, P A = 0.48, pf> = 0.01 and p£ ] = 0.85 at 1600 steps. 

occurs. I examine carefully those considerations. As a result, I find that Parrondo's paradox can 
occur in the present naive case on scale free networks. This paradox is, however, created by a quite 
different mechanism from the original Parrondo's paradox. The occurrence of the paradox is very 
subtle and a considerably rare phenomenon, where the discreteness of degree of nodes is crucial. I 
call it the second Parrondo's paradox because it is created by a quite different mechanism. 

2 Review of Parrondo's Paradox 

2.1 Original Game 

I give a brief review of the original Parrondo's game in this section. Parrondo's paradox occurs 
in sequences of games in which a winning expectation may be obtained by playing two games in a 
random order, even though each game in the sequence may be lost when played individually. The 
original version of Parrondo's game consists of the following two games; 



• Game A: the probability of winning is Pa in this game. Pa < 0.5 is taken for losing game. 

• Game B: If the capital C(t) of the player at t is a multiple of 3, the probability of winning 



is Pg \ otherwise, the probability of winning is Pg 

• Game A+B: Two games are mixed. The game A is played with probability P and Game B 
is played with 1 — P. 

In all there are 4 parameters, P, Pa, and P^ \ controllable by a planner of the game in 

Parrondo's game. When we win Game A or B or A+B, we get one unit of capital and when we 
lose the game, we lose one unit of capital. 

Time series of C(t) of Game A and Game B are given by Fig.l, respectively, where C(0) = 100 
is taken. They show that the capital C(t) decreases with time t in both the games. Fig 2, which 
displays the time series of the game A+B, however, shows that the capital C(t) increases with time 
t. This is an example of Parrondo's paradox. 
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This paradox can be understood by an analysis using a difference equation for the probability 
that the capital reaches zero in a finite number of plays when we initially have a given capital of 
j units [I], [1]. 

The game A is classified into the following three cases as result; 
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Game B is also classified into the following three cases by the similar way; 

(B) < •"■ winning game, (5) 
D^X = 1 fair game, (6) 

D\b) > 1 losing game, (7) 

where 

_ (l-pW)(l-Pf)2 

PAiP^) 2 

Game A+B where Game A is chosen randomly with the probability P or Game B with the 
probability 1 — P. I classify the game into two cases as in Game B. 

• The case that the capital is a multiple of three. The winning probability is 

P^ B =PP A + (1-P)P B 1) . (9) 

• The case that the capital is not a multiple of three The winning probability is 

P%l B ^PP A + (l-P)P B 2) . (10) 

So it is found that Game A+B is included in Game B as a special case by the following replacement; 
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Game A+B is classified such as Game B 

(13) 
(14) 
(15) 

The game A can be also considered as Game B with P B ^ = P B ^ = Pa- Considering it together 
with eq. (11), both Game A and Game A+B are essentially special cases of Game B. Thus I can 
represent the discriminants in the unified way by replacing the subscript B with A or A+B in eq. 
(5)-(8). 

When the conditions 

(A) ■> 1 > U (B) ■> 1 > (A+B) ^ 1 y 10 ) 

are simultaneously satisfied, Parrondo's paradox occurs. 
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2.2 Some Extensions of Parrondo's Paradox 



Let consider the a more general case that when a capital satisfies mod(C(t),M) = for a 
itive integer M, a gai 
'inning probability F 
discriminant is given by 



positive integer M, a game with a winning probability Pjp is played and the another game with 

(2) 

a winning probability P B is played in the cases of mod{C{t),M) ^ in Game B. Then the 
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Then it is known that the paradox occurs under the conditions like eq. (16) [5] • 

Such paradox also occurs in some extended versions of the original Parrondo's game. One of 
them is that two games in Game B are chosen depending on historical information as to winning- 
losing 6 . Some theoretical discussion are given for the game [7]. 

The case that players lying on one dimensional circle lattice play Parrondo's game as an other 
case[8 ,[9 ,[10 is investigated. Then two games in Game B are chosen depending on information 
as to winning-losing of two adjacent players ( left and right of the target player). Moreover the 
case is extended to two dimensional regular lattice with the periodic boundary condition [TT]. It 
has been verified that the paradox can also occur in these cases [8] .[TT]. 

Next I briefly review the extended case to two dimensional lattice according to Mihailovic et 
al. |llj . They introduce five subgames in Game B, depending on one winner, two winners, three 
winners, four winners in von Neumann neighborhood of a target player. The target player plays 
one of games with the winning probability of Pg Cpg Cp^Cpg and Pg corresponding to the 
number of winners of his/her adjacent player. So Game B has five parameters. They analyze 
the average capital over all players as the time series of capitals. As result, they report that the 
paradoxical phenomena occur in wide range of parameter sets, especially it appears typically in 
synchronous cases where all players play at the same time. 

3 Parrondo's Paradox on Scale Free Networks I 

3.1 Parrondo's Game I on Scale Free Networks (Threshold Game) 

The degree distribution of scale free networks with the lowest degree k m in is given by 

P(k)=ck- a = k ~° (18) 

Cl": k min ) 

where a > is an exponent in a power low, c is a normalization constant and the Hurwitz zeta 
function is defined by 

oo 

C(«) kmin) = ^2i n + k„iin)~ a - (19) 
n=0 

In this article, I construct scale free networks by using the preferential attachment (BA model) 
introduced by Barabashi et al. [E],[l5] where the scaling exponent is theoretically a = 3 (Barabasi 
et al. have actually shown that a = 2.9 ± 1 for BA model with a fewxlO 5 nodes [T3],[T5] ). In this 
article, I begin with the complete graph with degree 4, nodes with degree 4 to the initial graph are 
attached by using BA model up to the network size N. 

I consider a naive extension of Parrondo's game on scale free networks. Parrondo's game is 
straightforwardly extended to the game with degree k, which means the player on the node with 
degree k plays against k players, according to |llj such as explained in 2.2. Then the number of 
parameters appearing as the winning probabilities becomes k + 1 and that is so large. The reason 
is that there can be ~ k winers in the adjacent to the target node with degree k. When the 
target player plays different games depending on the number of winners adjacent to him/her, the 
discriminant of the node with degree k is generally given by 
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Figure 3: (Pw,bGPl,b) that satisfies the condition eq.(23) and (24) at R 
kmax = 25, at R = 30 for k max = 65 and at R = 73 for k max = 1 50. 
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Figure 4: Average capital C(t) and capital distribution in every node in Game B (left) and Game 
A+B (right) at R= 10 and {P l ,b,Pr) = (0.6,0.2). 

where pi g is the winning probability in the case that there are i winners adjacent to the target 
player in Gamea. So k + 1 games are necessary. Furthermore every node has different degree in 
scale free networks, and so by all accounts, such game has too many parameters to analyze the 
game theoretically. 

So I introduce a cutoff R as a simple idea to analyze the game on scale free networks. When 
there are not more than R winners adjacent to a target player, the target player plays Game L 
whose winning probability is Pl.b, and the target player plays Game W whose winning probability 
is Pw,b m other cases in Game B. Then the number of parameters of the games is the same as the 
original Parrondo's game due to this simplification. So the discriminant for the node with degree k 
for Game B in this Parrondo's game on scale free networks based on analogical inference of eq.(17) 
is 
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We need only to replace the subscript B with A + B for Game A+B where the relations of 
winning probability between both games are essentially given by eq.(9) and eq.(10). 

Since Parrondo-like paradox may accidentally occur in the capital of individual because of 
probability game, I focus my analyses on the average capital over all players as the time series of 
capitals in similar manner to the game on two dimensional lattice [TO]. 



3.2 Theoretical and Numerical Studies 

In this case, it may be effective that the theoretical analysis is made via DTMC (discrete- 
time Markov chains) such as given in [5] , [9] , [10] . As exploring Parrondo's paradox following this 
analysis, there is a difficulty, because every node, however, has a different degree in a scale free 
network and so the size of the transfer matrix can not be fixed. Therefore the analysis based on 
DTMC is difficult for scale free networks. I make the analysis in this case based on the mean field 
approximation such as a recursion relation. 

Let's consider the condition that some paradox occurs in this game. Notice that when the 
degree of nodes is smaller than the cutoff R, the players on the nodes necessarily play Game L in 
Game B. Then the discriminant is given by 



D 



(1 - Pl,bY 



L,B 



(22) 



Players on nodes with high degree can play cither Game W or Game L corresponding to the 
number of winners in neighboring players. Taking account of k m i n — 4 in BA model adopted in 
this article, Using the expectation values of the discriminant, I find the following conditions for 
the occurrence of the paradox in the continuous approximation; 
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(£( & ,p. +b) ) - ( ^ ^ + ^ dK) x fe i^_ fc U > 1, (24) 

where c = fci in the continuous approximation [TJ]. I will investigate these conditions by 

making numerical calculations. 

Fig. 3 shows the typical data points that satisfy the conditions eq.(23) and eq. (24) at various 
R, P = 0.5 and N = 400. I confirmed that the data points with large P\v,b in the left end of Fig. 3, 
which appear at small R, disappear as k max becomes larger. As for large R, data points appear 
in some straight lines shown in Fig. 3. These points appear at still larger R (so necessarily large 
kmax) as shown in the right end of Fig. 3. As R becomes larger, the gradient becomes smaller and 
the number the total data points reduces. From a series of these figures, it is conjectured that the 
data points in the straight lines will disappear at the limit of N — > oo, which would be due to a 
sort of the finite size effect. From these facts, I surely speculate that Parrondo's paradox does not 
occur on scale free networks with the cutoff game which has the same number of parameters as 
the original one. 

Moreover I put to the test by a computer simulation at N = 400 and P = 0.5 in order to 
ensure the conjecture. The region that should be explored in the parameter space Pl,b~Pw,b for 
the paradox are limited to 

{Pl.b - 0.5)(P W ; S - 0.5) < 0. (25) 

This is because of Pl.b Pw,b duality symmetry in the present case. Computer simulations are 
made under this parameter region where each player on the network asynchronously plays with 
C(0) = 100. In the case of R = 10 and Pl,b > 0.5 > P\y,B, a typical time series of an average 
capital over all players at t = 1000 are shown in Fig. 4 for Game B and Game A+B. In general, 
the average capital Cs(i) in Game B is lager than C^+s(t) in Game A+B. So it would be difficult 
that the average capital in Game A+B exceeded the one in Game B. 

In the case of R = 10 and Pl.b < 0.5 < P\v,b, there are not any essential differences from the 
above cases except that both the Cs(i) and CU+s(i) decrease due to the duality of Pl,b Pw,b- 
Furthermore, the variations of Pl,b and Pw,b within above two parameter regions have an effect 
on only the variation of the absolute values of Cs(i) and Ca+b^) but does not occasion any 
qualitative changes such as a reversal in capital. I can actually show that decreasing R makes 
losers increase in the case of R = 10 and Pl,b > 0.5 > Pw,b, but makes losers decrease in the case 
R = 10 and Pl,b < 0.5 < Pw r [T7] . These circumstantial evidence shows that the variation of 
R contributes only to the absolute value of the capital, and does not bring about any qualitative 
change such as the occurrence of paradox. 

As result of all simulations, I also found that paradox does not occur in these data points 
at these R. It is a future problem whether paradox actually occurs at exceedingly larger R in 
large scale networks. But taking account of also theoretical considerations, I surely speculate that 
Parrondo's paradox does not occur in the threshold game on scale free networks. 



4 Parrondo's Paradox on Scale Free Networks II 

4.1 Parrondo's Game II on scale free networks (threshold ratio game) 

I consider another naive extension of Parrondo's game on scale free networks. I prepare a 
cutoff for winners' ratio r rather than the number of winners adjacent to a target player. When 
there are not more than rki winners adjacent to a target player i, the target player plays Game L 
whose winning probability is Pl.b, and the target player plays Game W whose winning probability 
is Pw,b in other cases in Game B. The number of parameters of the games is also the same as 
the original Parrondo's game due to this simplification. Then the discriminants for the node with 
degree k for Game B and Game A+B are 

n (l-Pxv,B) k - R (l-PL,B) R (e)e , 

u (k,p w .B,PL,B) - pk-RpR ' y Zb > 

r W,B L.B 

n _ (1-P W ,A+B) k - R (l-PL,A + B) R 

1J (k,P W ,A+B,PL,A+B) — pk-R pR ' \ ZI > 

W, A+B L, A+B 








Figure 5: The average capital C(t) ( C(0) = 100 ) at {P l ,b, Pw,B,r) = (0.68,0.092,2/3) in Game 
B (left) and Game A+B (right) in the threshold ratio game where the network size is 1000. 

where R = rki . The conditions that some paradox occurs are 

D (k,P W ,B,PL, B ) > !) ( 28 ) 
D (k,Pw,A+B,PL,A+ B ) < ( 29 ) 

where P A < 0.5 and P = 0.5 is taken. It is natural because Game A is losing. When the ratio of 
winners to total players adjacent to target one is r, (28) and (29) become 

> P LiB , for P L m < 1 < P W , B , (30) 



> Pw,b, for P WtB <\< Pl,b, (31) 



and 

I , pj, A+B < P L,A+B, for Pl,a+b < \ < Pw,a+b, (32) 

1 + \ l-Pw,A+B> 

57- r < Pw,a+b, for Pw.a+b < \ < Pl.a+b, (33) 

1 + \1-P L ,A+B> 

respectively, where (3 defined by the below does not depend degree k; 

k — R k — rk 1 — r 



p. (34) 



R rk r 

First of all, I discuss (31) and (33). The necessary conditions for satisfying both inequations 



are 

: : l LB 7i > Pw,b, (35) 

Pa + Pw,b > 1, (36) 
Pl,b>\ > Pw,b- (37) 

The below parameter set satisfies the condition (35), (36) and (37); 

{P A ,Pw,B,Pw,L,r,P) = (0.49,0.1,0.68,2/3,0.50). 

So they are candidate parameters for a paradox. Fig. 5 really shows that a paradox in the average 
capital occurs at the parameter set where C(0) =0 and the network size N = 1000 are taken. 

However, since the conditions for the Parrondo's paradox have not any k dependence from (34), 
I notice that the wining probabilities for Game B and Game A+B are given by 

P B = rP WiB + {l-r)P L , B , (38) 
P A+B = pP A + {l-p)(rPw,B + {l-r)P L . B ). (39) 
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Two kinds of probabilities for the occurrence of the paradox are needed for any nodes such as in 
the original Parrondo game B. Thus there is, however, no sign of the paradox in this case. In fact 
substituting (38) into (39), we obtain 

P a+ b = pPa + (1 - p)Pb = p{Pa - Pb) + P B - (40) 

So Pa+b < 0.5 for p = 0.5 or even p < 1, Pa < 0.5 and 0.5 > Pb- These consideration clearly 
show that both game B and game A+B are losing!. 

I investigate why the Parrondo's paradox occurred in the Fig. 5. Notice that effective r is 
always some rational number different from true r for a special k, since k takes only a natural 
number, r takes some effective value r e ff due to the discrete effect of k. For example, when the 
possible winning ratios of a node with k = 4 are 0/4, 1/4, 2/4, 3/4 and 4/4. So choosing r = 2/3, 
r becomes effectively r e // = r upper = 3/4 for W game. For L game, r likewise becomes effectively 
r e ff — rdown — 2/4. Thus two effective rs' appear! 

For the same parameters as ones in Fig. 5, the effective values of r upper and rdown are summarized 
in Table 1 for each degree k. Table 1 includes Pe,e// and PA+B,eff that are evaluated from 
the formula substituted from r to r e ff in (38) and (39). The average values < PB,eff > and 
< PA+B,eff > are given by 

< PB(A+B),eff > = J P{k)P B (A+B),eff{k) = j ck~ a P B (A+B),ef f (k) ■ (41) 

Since this value is sensitive to the normalization constant c, we refine parameters in the present 
model. I first use a = 2.57 (driven based on the least squares method) for the network really 
constructed in this article, different from ideal value a = 3. Though k can take infinite large 
value in itself, k really takes from k m i n = 4, which is a restriction coming from BA model, to 
kmax = 30[T7] in Table 1. The average values of Pe,e// and PA+B,eff in Table 1 is are obtained, 
when the normalization constant evaluated from this limited region of k is corrected to 1.051 times 
of the real value eith k max = 30. Then the capitals Cs(t = 1000) and CA+B{t = 1000) are also 
obtained in Table 1. These values almost explain the capitals of game B and game A+B in Fig. 
5 well. The exact theoretical correction for the normalization constant without any limit of k is 
1.035 which is comparable with the above value. 

There are effectively multiple r values, and so multiple < Ps.eff > and < PA+B,eff >, due to 
the various effective r e ff as shown in Table 1. Such the effect creates Parrondo's paradox in the 
similar way as the original Parrondo's game, but not in different mechanism from the original one. 
Thus I call its paradox the second Parrondo's paradox. 



5 Summary 

In this article, I explored whether paradox occurs or not in Parrondo's game on scale free 
networks which are more ubiquitous in real worlds than regular networks. It is too complicate 
to analyze the game in the general fashion, especially in giving theoretical considerations. So 
I consider only the case with the same number of parameters as the original Parrondo's game 
based on modulo M = 3 in the capital. In this article, the parameter corresponding to M in the 
original Parrondo's game is the cutoff R. When the number of winners adjacent to a target player 
is not more than R, the player plays Game L with the winning probability Pl.b m Game B of 
Parrondo's game. Otherwise the player plays Game W with the winning probability Pw,b- Two 
types of models are considered in this article. One is the the threshold game where R takes a 
constant value independent of degree k. Another is the threshold ratio game where R depends on 
degree ki of node i such as Ri — rk{. r means the ratio of winners to all players adjacent to the 
player on node i. 

For the threshold game, I accumulated circumstantial evidence that paradox does not occur 
by some computer simulations. Furthermore I almost practically showed that Parrondo's paradox 
did not occur in this naive case from theoretical point with numerical experiments of view. It, 
however, remains to be studied whether some paradox actually does not occur in excessively large 
scale networks. 

I showed that a paradox occurred for some parameter set in the threshold ratio model. In 
this case, the discrete nature of k effectively induces plural winning probabilities in game B as 
the original Parrondo's game. It is thought that the various PB,eff or PA+B,eff appearing in this 
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model create the paradox. The plural winning probabilities in game B are not given artificially as 
the setting of the game but they are effectively induced by the discrete nature of k. So I called the 
paradox the second Parrondo's paradox. 

I never showed that it was hard to create Parrondo's paradox in scale free networks, generally. 
Notice that the networks that I studied is only BA models and only studied excessively naive 
setting in game B. I only focus my attention on the numbers or the ratio of winners, and not on 
degree or the number of losers (notice that considering both the number of losers and winners 
turns out to consider degree and the number of winners as well). If making efficient use of these 
information, we would find more rich aspects of Parrondo's paradox in various types of scale free 
networks. 
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r=2/3 


Pw,b=0.092 


Pl.b=0.68 




P=0.5 


V 


r 

1 upper 


l down 


p 

B ,eff 






0.750000 


0.5 


0.409 


0.4495 




0.800000 


0.6 


0.4816 


0.4858 




0.833333 


0.66666667 


0.53 


0.51 




0.714286 


0.57142857 


0.45429 


0.472143 


8 


0.750000 


0.625 


0.494 


0.492 




0.777778 


0.66666667 


0.52489 


0.507444 




0.700000 


0.6 


0.4724 


0.4812 




0.727273 


0.63636364 


0.49964 


0.494818 




0.750000 


0.66666667 


0.52233 


0.506167 




0.692308 


0.61538462 


0.48215 


0.486077 


14 


0.714286 


0.64285714 


0.50286 


0.496429 


15 


0.733333 


0.666667 


0.5208 


0.5054 




0.687500 


0.625 


0.48825 


0.489125 




0.705882 


0.64705882 


0.50494 


0.497471 




0.722222 


0.66666667 


0.51978 


0.504889 




0.684211 


0.63157895 


0.49242 


0.491211 


20 


0.700000 


0.65 


0.5064 


0.4982 




0.714286 


0.66666667 


0.51905 


0.504524 




0.681818 


0.63636364 


0.49545 


0.492727 


23 


0.695652 


0.65217391 


0.50748 


0.498739 


24 


0.708333 


0.66666667 


0.5185 


0.50425 




0.680000 


0.64 


0.49776 


0.49388 




0.692308 


0.65384615 


0.50831 


0.499154 




0.666667 


0.66666667 


0.51467 


0.502333 




0.678571 


0.64285714 


0.49957 


0.494786 




0.689655 


0.65517241 


0.50897 


0.499483 




0.700000 


0.66666667 


0.51773 


0.503867 






average 


0.49975 


0.494875 




averaged 

Peff. 


0.49 


0.503 


Capital 


-19.2 


5.414 



Table 1: Average capital C(t) and capital distribution in every node in Game B and Game A+B 
at r = 2/3 and (Pl,b,Pwm) = (0.68,0.092). 
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